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^ ; Abstract 

^ I '■ In this paper, we propose a statistical theory on measurement and estimation of Rayleigh 

. fading channels in wireless communications and provide complete solutions to the fundamental 

I problems: What is the optimum estimator for the statistical parameters associated with the 

I Rayleigh fading channel, and how many measurements are sufficient to estimate these param- 

' eters with the prescribed margin of error and confidence level? Our proposed statistical theory 
suggests that two testing signals of different strength be used. The maximum likelihood (ML) 

. estimator is obtained for estimation of the statistical parameters of the Rayleigh fading chan- 

^ I ncl that is both sufficient and complete statistic. Moreover, the ML estimator is the minimum 

' variance (MV) estimator that in fact achieves the Cramer-Rao lower bound. 

(N ■ 
p ; 

■ 1 Introduction 

o ; 

^ I In mobile radio channels, the Rayleigh distribution is commonly used to describe the statistical 

^ I nature of the received envelope of a flat fading signal, or the envelope of an individual multipath 

^ I component. Flat fading is often associated with the narrow band channel. By assuming that the 

^ I real and imaginary parts of the channel gain are independent Gaussian random variables with 

zero mean and equal variance, the amplitude of the channel gain or PL (path loss) becomes a 
Rayleigh random variable. For wide band channels, multipath gains are typically assumed to 
be uncorrelated scattering (US) and each path gain is wide-sense stationary (WSS) which are 
termed as WSSUS channels [2]. By assuming that the real and imaginary parts of each path 
gain are independently Gaussian distributed with zero mean and equal variance, the amplitudes 
of the multipath gains become independent Rayleigh random variables. Theoretically a Rayleigh 
random variable is uniquely specified by its 2nd moment that is the sum of the variances of its two 
independent Gaussian components. In practice the statistics of the Rayleigh fading channel are 
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incomplete without additional knowledge of the noise power and SNR (signal-to-noise ratio) . That 
is, the statistical parameters of the channel power, noise power, and SNR together characterize 
the Rayleigh fading channel completely, giving rise to the measurement and estimation problem 
for these statistical parameters. 

Estimation for the 2nd moment of a Rayleigh random variable has practical importance in 
channel modeling and estimation [3l [9l [12], and in radio coverage, location, and measurement 
[H [8]. For these reasons statistical estimation of Rayleigh fading channels has been studied 
and reported in the existing research literature. The early work of Peritsky [13] shows that 
the simple averaged square of the signal strength based on i.i.d. (independent and identically 
distributed) measurement samples is both an ML (maximum likelihood) and MV (minimum 
variance) estimator, and such an averaged square is a sufficient and complete statistic. However 
his results focus only on the noise- free case and have limited applications. The same problem 
has been investigated in [H [6l [3 [THl [HI [13 [20] that encompass the Ricean and Nakagami fading 
distributions, as well as MIMO fading channels. But there lack optimum estimators that achieve 
the Cramer-Rao lower bound. 

In this paper we propose a statistical theory on measurement and estimation of Rayleigh fading 
channels. Our contributions include derivation of explicit a priori bounds on the measurement 
sample size that achieve the prescribed margin of error and the confidence level, and discovery of 
the optimum estimator that is both an ML and MV estimator, and achieves the Cramer- Rao lower 
bound. These results complement the existing work reported in the literature. In the noise-free 
case our sample size bound resembles the one implicitly indicated in [5] which asserts that, to 
estimate the binomial probability with the prescribed margin of absolute error e and confidence 
level 1 — (5, it suffices to have a sample size greater than One notable difference is that our 

sample size bound is derived for the relative error while the bound in [5] is derived for the absolute 
error in estimation of the binomial probability. Furthermore an interval estimate similar to that 
in [13] is obtained with much simpler calculation. 

In applications to Rayleigh fading channels, noisy measurement samples have to be taken 
into consideration. Our proposed statistical theory suggests that two testing signals of different 
strength be used. The use of two different testing signals enables us to extend the sample complex- 
ity results from the noiseless case to the noisy case which solves the sample complexity problem 
not only for the 2nd moment or the mean channel power, but also for the mean noise power and 
for the SNR. The explicit a priori bounds resemble to those in the noise-free case of which the 
sample size is roughly inversely proportional to the square of the margin of error and is linear 
with respect to the logarithm of the inverse of the gap between the confidence level and 1. Our 
results show that a typical margin of error can be achieved with near certainty and modest sample 
size. More importantly an optimum estimator is obtained for noisy Rayleigh fading channels that 
is both an ML and MV estimator. It inherits the same sufficient and complete statistic property 
from that in the noiseless case |13j . and it achieves the Cramer- Rao lower bound. 
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The content of the paper is organized as follows. In Section 2 we first present the Rayleigh 
fading channel and its associated measurement and estimation problem in terms of the sample 
complexity and the optimum estimator. The sample complexity problem is then addressed in 
Section 3 by establishing an explicit a priori bound on the sample size that is asymptotically 
tight based on noiseless measurements. In Section 4 we present our main results on parameter 
estimation for Rayleigh fading channels by taking the noisy measurement samples into consider- 
ation to which complete solutions are derived for measurement and estimation of Rayleigh fading 
channels. Numerical examples are presented in Section 5 to illustrate our results, and the paper 
is concluded in Section 6. The notations are standard and will be made clear as we proceed. 



2 Rayleigh Fading Channels 



In a typical urban environment, there is no LOS (line of sight) between the transmitter and the 
receiver. The wireless channel is characterized by multipath and follows the Rayleigh distribution. 
Specifically a widely used channel model is the following continuous-time CIR (channel impulse 
response): 



TV 



c(i;r) = ^«„(t)e^'^"W5(t-r„(t)) 



(1) 



n=0 



where an{t)., (3n{t), and r„(i) are the amplitude, phase, and time delay, respectively, associated 
with the nth path, and 6{-) is the Dirac delta function. For narrow band systems, the channel 
gain is given by 



H{t) = HR{t)+jHi{t) :-- 



■ N 

^a„(t) cos((/)„(t)) 

.n=l 



+ j 



N 



^a„(t) sin((/)„(t)) 



.n=l 



(2) 



The arguments {(l)n{t)} are due to {(3n{t)} and {T„(t)} induced by Doppler shifts and time delays 
that form a set of independent random variables uniformly distributed over [— vr, vr]. Under the 
assumption that «„(*) = Pn{t) = f3n, and r„(t) = r„, H{t) becomes a WSS (wide-sense 
stationary) process. For large A^, the central limiting theorem can be invoked to treat both Hji{t) 
and Hi{t) as independent Gaussian random processes with zero mean and equal variance [HI [18]. 
This gives rise to the Rayleigh fading channel in light of the fact that \H{t)\'^ is a Rayleigh random 
variable. For wide band systems, multipath gains can be resolved up to the resolution dictated 
by the sampling frequency fs- An equivalent discretized CIR can be represented by 



L-l 



(3) 



A;=0 



in which |i?fc(t)p is Rayleigh distributed for < k < L where 5t is the Kronekar delta function. 

Rayleigh fading channels are widely used in wireless communications. An important and prac- 
tical problem is measurement of \H{t)\'^ and estimation of E[|ff(t)p], with E[ • ] the expectation. 
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for narrow band systems, or \Hk{t)\'^ and power delay profile E[|iJfc(t)p] for wide band systems. 
Such a problem is crucial in modeling and estimation of wireless channels, and in radio coverage 
and location. A common strategy is to transmit i.i.d. pilot symbols or testing signals to obtain 
measurement samples of \H{t)\'^ or and then to estimate the mean. For simplicity we 

drop the time argument t, and focus on narrow band systems but our results are applicable to wide 
band systems as well by converting frequency-selective fading channels into flat fading channels 
using the OFDM (orthogonal frequency division multiplexing) scheme [12]. The detail is omitted. 

Denote 3f?[C] as the real part of the complex number C. Let the transmitted symbol be S. In 
the complex form, the received signal can be written as ("=^" stands for "implying") 

x{t) = ^[{HS + V)e^^^f^*\ ^ X = HS + V (4) 

where fc is the carrier frequency and V = Vr, + jVj is the complex additive Gaussian noise with 
zero mean and equal variance ay. Since the average power of the transmitted signal is Pg = E[|S'p] 
and the average power of the received signal is E[|ffS'p], the channel power or PL is 

where ajj is the common variance of Hji and Hj. It can be seen that ajj depends on the 
attenuation factors {a„} that decrease as the receiver is further away from the transmitter. It 
follows that ajj and thus SNR become small when the receiver is far away from the transmitter. 
To predict the coverage and the performance of wireless systems, it is important to know the 
operating range of the SNR at different locations. The SNR at the receiver is easily found to be 

SNR. 101og.„ (M) . (MM) . 10.o,„ (EIISI^I) . 101og„ (I) 

where ay is the common variance of Vr and Vj. Since Pg = E[|S'p], the average power for 
transmitting the symbol S, is computable, to obtain an estimate for the SNR it is necessary 
to have an estimate for the ratio of aj^ to (jy. However it remains unclear whether or not the 
knowledge of SNR helps to estimate the PL that will be investigated later. Our main results to 
be presented show that with appropriate signaling, the variances aj^, ay, and the SNR can all be 
estimated in satisfaction. 

The objective of this paper is in fact beyond estimation of the PL that has been investigated 
by several researchers (TJ [lOl [TTl [131 [13 [20] • Our goal is to develop a relevant statistical theory in 
order to derive an optimum estimator for the statistical parameters associated with the Rayleigh 
fading channel, and to derive a priori sample complexity bounds given the prescribed margin 
of error and the confidence level. These two problems are not completely solved in the existing 
research literature that will be studied thoroughly in the next several sections. We will begin with 
the ideal case of noiseless measurements by assuming independent PSK (phase shift keying) or 
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BPSK (binary PSK) signaling at the transmitter leading to N independent measurement samples 
{Xi}^i at the receiver. In light of [13] . 

_ W 1 ^ 



i=l 



is an ML estimator for a'jj that is both statistically sufficient and complete. We thus have an 
equivalent problem for estimation of the 2nd moment of the Rayleigh random variable based on 
its N i.i.d. samples. The complete results on sample complexity in this case will be presented in 
the next section. 

After solving the sample complexity problem in the noise-free case, we will investigate the 
sample complexity problem in estimation of the PL, the noise power, and the SNR, associated 
with Rayleigh fading channels based on noisy measurement samples. Two sets of independent 
BPSK signals {^i.Jfii and {S2,^} are transmitted with difference in their average power: 
l^i^ip = Psi and |5'2,ip = Ps2 for all possible i where Pgi > Ps2 > 0. The following two quantities 

^ i=i ^ i=\ 

turn out to be sufficient and complete statistics in statistical estimation of the Rayleigh fading 
channel based on noisy samples. In fact the optimum estimator is obtained that achieves the 
Cramer-Rao lower bound. Complete results are obtained and will be presented in a later section. 



3 Sample Complexity in the Noiseless Case 

As discussed earlier estimation of the 2nd moment for the Rayleigh fading channel in the noise- 
free case is equivalent to that for the Rayleigh random variable. Let X be a Rayleigh random 
variable with PDF (probability density function) 

^e"~, if X > 

M ' - (7) 

0, if X < 

Then X"^ = X'^ + Xj where Xji and Xj are independent Gaussian random variables with zero 
mean and equal variance = n/2. As it is seen, the PDF of the Rayleigh random variable is 
completely specified by its 2nd moment fi = E[X^] = 2cj^. To estimate fi, it is conventional to 
obtain N i.i.d. observations Xi, ■ ■ ■ ,Xn and take 

n - ^ -^AT (CiX 

fJ'N - (»j 



as the estimator of fi. It is shown in |13j that the above estimate is a sufficient statistic with 
good performance and asymptotically unbiased with large sample size. In addition an algorithm 
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is derived in [13] to compute the interval estimate of /x that is a function of the sample size 
and involves the use of the tabulated CDF. However thus far there does not exist a formula 
in the literature to estimate the sample size given the interval size and confidence level which 
will be provided in this section. Different from the result in |13j . we begin our investigation on 
relative error. Let S be an event, and denote Pr{5} as the probability associated with event S. 
Specifically we aim at solving the following problem: Let e and 5 be positive numbers less than 
1; Given margin of relative error e and confidence level 1 — 5, how large should the sample size N 
be to ensure 



<e} >l-67 (9) 



Pr 

Our first result is the explicit formula for computing the sample size as presented next. 

Theorem 1 Let e and 5 be positive numbers less than 1. Then the probability inequality @ holds, 
if 

2(3 + 2e)ln| , ^ 

N > ^ ' (10) 

Remark 1 Theorem [1] shows that for small values of e and 5, the a priori bound on the sample size 

2 In - 

in (jlOp can be approximated as . As a result, the sample size is roughly inversely proportional 
to the square of the margin of relative error and is linear with respect to the logarithm of the 
inverse of the gap between the confidence level and 1. In addition, an important feature of 
Theorem [T] is that the sample size bound is independent of the value of the true second moment. 

Theorem [T] does not use the margin of absolute error as the measure of accuracy. Its reason 
lies in the fact that if the margin of absolute error is used then the sample size is essentially 
dependent on the unknown second moment /x, which is to be estimated. Quite contrary, when 
the margin of relative error is used, the sample size can be determined without any knowledge of 
the unknown ^u. Moreover the relative error is a better indicator of the quality of the estimator: 
an estimate with a small absolute error may not be acceptable if the true value is also small. 
Nevertheless Theorem [1] will be used to provide an interval estimate for /i given the sample size 
and the confidence level or provide sample complexity bound given the estimation interval and 
confidence level that is similar to a result in [13] but without complicated computation. The 
sample complexity result for the interval estimate will be presented at the end of this section after 
the proof for Theorem [TJ First we will state and prove the following result that indicates that the 
a priori bound in pU|) is tight as e and 5 become small. 

Theorem 2 Under the same hypothesis o/ Theorem [71 define iV(e, 5) as an integer such that 

^^-^<4>i-4 (11) 



iV(e, 6) ■.= mm\N >Q: Pr 



Let N{£, 5) = ri^ij^i]L<L_ Then for each ^ > and with Zs satisfying e ^^/^ dx = 1 — |, 



, , N(e,5) , 21n| 

lim lim = lim — / = 1 12 

s^oe^o N{e,5) s^o ^ ' 
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Proof. By the central limit theorem, we can write 



Pr 



UN - 1^ 



< e 



1 



exp 



--]dx+aN) 



'2-K JeVF 

where C(-^) is a function of N such that limAr_+oo C(-^) = 0- Recall Zs in the statement of the 
theorem. It follows that the minimum sample size N_ = iV(e, 5) satisfies 



exp 



ex/N 



6+ am 



Nie,S) 



y2 

<5+C(iV) 



Since is a continuous function of b and C(i^) ^ as e ^ or ^ oo, we have 



lim 



that verifies the first half of (jl2p . Alternatively since 



21n| 
^1 



1 



exp 



we have that — > co as 5 — > 0. Consequently, 



2 2 



1 



27r 



27rZs 



exp 



72 
^5 



as (5 ^ 0. Taking the natural logarithm on both sides with appropriate rearrangement yields 



lim — / 



lim 

<5->0 



1 + 



ln(27rZ| 
^5 



and therefore (|12p follows that concludes the proof. 
Proof of Theorem [1) It can be seen that 



□ 



Pr 



Note that has mean 1 and possesses a distribution with 2 degrees of freedom. Because 



> e 



N 



Pr 



X. 



N 



X 



. i=l 



. i=l 



(13) 



< —f - [• are i.i.d., random variable R = J2i=i ~rr possesses a x distribution with 2N degrees 
of freedom. By equation (2.1-138) in page 46 of [15], we have 



AT 



N-1 



Pr\Y.Xf>N{l+e)A=e-^('^^^Y. 

J k=0 



[N{l + e)Y 



. i=l 



k\ 



Define a Poisson random variable Y with mean 9 = N{1 + e). Then 
Pr I^Xf > Ar(i +e);^| = Pr{y < A^} < inf E[e^(^-^^] 



inf e-V' 

A<0 
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where the Chernoff bound from [5] is apphed. It is easy to see that the infimum is achieved at A = 
ln(f ) < for which we have e'^e''^^-^^ = e"^ (^)^. Consequently Pr{y < iV} < e"^ (^)^ 
and 

{^^^' - + "^^} = ^'^^ < - {^y = + < ^ ^^^^ 

provided that N > ^""-^^ 



e-ln(l+e) " 

Similarly define a Poisson random variable Z with mean = A^(l — e). Then the Chernoff 



bound leads to Pr{Z > N} < e ^ iw)'" ^® earlier. It follows that 



{N ^ / 9 \ ^ 

Y,Xf<N{l- e)A = Pr{Z > N} < e^' (^^ j = e'^ [(1 - e)ef = [(1 - e)e^f < 

1 ('^'1 

provided that N > _g_inQ_g-) ■ Using the following inequalities (to be proven later) 



6_ 
2 
(15) 



-e-ln(l-e) 

3e2 



<e-ln(l + e) < -e-ln(l-e) V e G (0, 1) (16) 



2(3 + 2e) 

we have that if > ^ -^j^gj^ > > _Jfii^_^^ and consequently 



leading to Pr 



< e| > 1 — 6. Finally to prove the first inequality of (jl6p . define 

3e2 



(7(e) = e-ln(l + e) - 
dg{e) 10^2 



2(3 + 2e) 

Then ^(0) = and 

> 



de (l + e)(3 + 2e)2 

It follows that the first inequality of (jl6p holds. Similarly to prove the second inequality of (jl6p . 
define 

h{e) = £- ln(l + e) - [-e - ln(l - e)] 

Then /i(0) = and 

de 1 — e"^ 

Hence the second inequality of (jl6p is true. The proof of Theorem [1] is now complete. □ 

Remark 2 The a priori sample complexity bound in Theorem[Tl while being tight asymptotically, 
can be further improved by taking N = N^ai to be the minimum positive integer such that 

Fx\2N^M + ^)2A^ml) - F^^2N^,{{^ " ^)2iVml) > 1 " 5 (17) 
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in light of (jl3|) where F^2 2n{') is the CDF of random variable with 2N degree of freedom. 
Indeed there holds N > ^^^"'"g^^"^^^ > > iVmi . In addition for positive integer N < N^j^i , 



Pr ■ 







<4 


{ 











<l-6 (18) 



Although only the margin of relative error is investigated in Theorem [T] for the sample com- 
plexity problem in statistical estimation of the 2nd moment of Rayleigh random variables, a 
similar result can be obtained as well for the corresponding interval estimate. The probability 
associated with such an interval estimate will be termed as coverage probability to signify its utility 
in coverage analysis [U [8] . 

Corollary 1 (i) Let e and 5 be positive numbers less than 1. Then 

provided that N satisfies the sample complexity bound in (jiOp . Recall that Jim as in ^ is the 
maximum likelihood estimate for the 2nd moment. 

(ii) Let6e{Q,l), N >^\n(^), and 



21n| / / 9iV \ 



Then the inequality for the coverage probability holds. 
Proof. We note the following chain of equalities: 
Pr 



l^ 



Pr{(l -e)/. <Jlr,< (1 + 6)^} = Pr < < 



+ e 

Hence (i) holds true in light of Theorem [TJ For (ii) solving equation = ^^^^3^^'^^^^ with respect 

to e yields the unique positive root e as in (pOj) . Note that ^^^^gll'*^^^^ decreases as e > increases, 

and e = 1 is the unique positive root of A = ^^'^"'"3^1^°^^^ at A = ^ h:i(|). Therefore, the root e 
is less than 1 for A > ^ ln(|). It follows that (ii) holds true as well in light of Theorem [TJ □ 

Remark 3 

The problem of interval estimate has been investigated in [13] that proposes a computational 
procedure but without an a priori bound on the sample size as in Corollary [TJ Indeed it computes 
the exact value of PrjCi/fTv < ^ < ^2/1 at} = p given < p < 1 by searching for (Ci,C2) which 
are dependent on A and e and satisfy < Ci < 1 < C2. Although in a different form, Ci and C2 
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approach to 1 in accordance with Theorem [2] as N ^ oo. However the algorithm as proposed in 
[13] makes the use of the tabulated CDF repeatedly in searching for an appropriate interval 
and sample size that admit multiple solutions for a given p because of the trade-off between the 
interval length and sample size. Such a search is bypassed in Corollary [TJ In fact such a search 
is unnecessary that is completely characterized by (|17p . The explicit relation between N and 
(e, 6) enables us to compute an interval estimate for /i a priori given the sample size and the 
confidence level, or compute the a priori sample complexity bound given the estimation interval 
and confidence level that is in sharp contrast to the existing results in the literature. Numerical 
result indicates that our explicit formula in Corollary [T] on the sample complexity bound is very 
tight as shown on the left of Figure 1 with 5 = 0.01 where Ci and C2 are solved from (jl7p and 



1+e 



l-e 



(l + e)Ci Ci/Itv' {l-e)C2 Cs/Itv 

On the right of Figure 1 plots in unit dB vs. the a priori bound N that is a function of e, 
given 5. 




Sample Size 



- Ratio of Confidence Limits {by explicit formula) 
Ratio of Confidence Limits (cfti square) 




Sample Size 



Figure 1: Plots of 201ogio [inkcl) and 201ogio [jt^) (left), and 201ogio (^) (right) vs. 



In summary our results on the sample complexity are quite satisfactory as demonstrated in Figure 
1 that can in fact be extended to the noisy case. 



4 Measurement and Estimation with Noisy Samples 

Recall that in the noisy case two sets of i.i.d. BPSK symbols are transmitted with difference in 
their average power satisfying Pgi > Ps2 > 0. The problem is statistical estimation for a'jj, ay, 
and the SNR, as well as their associated sample complexity bound based on i.i.d. observations 
of the received signal X = HS + V which are recorded as and {X2^i}fli, respectively. 

We consider the case where Ni = N2 = N with Xf and ^l^y as defined in ([6]). Two different 
subjects will be investigated. 
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4.1 Interval Estimate 

We will demonstrate not only how to construct a simultaneous confidence interval based on the 
noisy measurements but also how tight these interval estimates are. Our main results begin with 
the following theorem that provides a simultaneous interval estimate and the solution to the 
sample complexity problem with an a priori bound. 



Theorem 3 Let e and 5 he positive numbers less than 1. Denote APg = Psi — Ps2- Then 

>l-5 (21) 



Pr { 



APs \ 1+e 1-e <- APs \ 1-e 1+e ' <^ 



1 / Ps'^^2,N ^^2^1, N \ ^ 9 1 / P^^^i.N 



APs \^ 1+e 1-e / ^ ^ APs \ 1-c 1+e 

provided that N > ^(^+2^(1) . 

Proof. For BPSK the transmitted symbol S is real with the transmitting power Pg = |«Sp, and 
thus 



X = HS + V = {HrS + Fr) + j{HiS + Vi) = yJiPscrj, + + jB) 

where A and B are independent Gaussian variables with zero mean and unity variance. Hence 
= {Psajj + al,){A'^ + B^) is Rayleigh distributed. It follows that {Xi^i}f^^ and {X2,i}fLi are 
both i.i.d. observations of X, and with Xf and X2 as defined in ([6]), 

E 



Applying (i) of Corollary [1] yields the interval estimate 




^^^<{p,y^ + a^y)<-^[>vr^, i = i,2 

for an appropriately chosen sample size A^. In fact the above holds, if 



2(3 + 2e)ln(^-^ 



-s 



N > (22) 

in light of Corollary [H The fact that ( 1 - VT^) ^ = 2-6- 2y/T^ > implies that 1 - > 
|. Hence the inequality in ([22]) holds provided that N > ^^^"'"^^^"^^^ as in the statement of the 
theorem. Now by the independence of the experiment, 



Pr 1^ < + 4) < ^ < (^.2^ + 4) < ^} > 1 - 

Define the following sets of events as illustrated in Figure 2: 

50 = {(c//,cry) • joint events in the probability expression ([2T]) hold} (23) 

51 = ((4,4): <^^^^"^+"^)<r^l ^''^ 



(4,4): n^<(^^^"^+"^)<r^l (''^ 
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We will show that 5i H ^2 ^ leading to Pr{5o} > Pr{5i H > 1 — 5 thereby concluding the 
proof. 




Figure 2: Illustration of the sets of events 



Indeed suppose that (cr|^, ay) G 5i n ^2 represented by the shaded area in Figure 2. Then 



The above inequalities can be combined to eliminate ay yielding 



On the other hand for (cj|^, ay) G 5i Pi 52, there hold 



^ < {PsiPs2(Th + -Psicrf ) < ^ _^ & 
—< —{^sl^s2(^H~^^s2(^V) < 1 + e 

The above inequalities can be combined to eliminate ajj yielding (aj^jay) G Sy with 



We can thus conclude that 5i n ^2 C 5o = Sh H represented by the rectangular area in Figure 
2. The proof is now complete. □ 

The proof of Theorem [3] shows that two signal sets of different strengths are necessary in order 
to resolve two different interval estimates for af^ and ay, respectively. Clearly signals of more 
than two different strengths become necessary in order to acquire more than two independent 
parameters in statistical estimation of wireless channels. Theorem [3] also shows that for N > 
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2{3+e)ln{|) 



- -^A7> IrS-S <^^<Ak S-fK 



Remark 4 In light of Remark 2 and the definition of 2Ar(-)) the sample complexity bound 
in Theorem [3] can be improved by taking = N^2, the minimum positive integer such that 



Px^2N^,{a + e)2N^2) - i"x^2iv^2((l - ^)2A^m2) > Vl^5 (28) 
Recall that SNR = 10 log^Q £[15"^] + lOlog^^Q it is both important and of independent 

2 

interest to obtain an interval estimate for -Jf that is presented in the next result. 

Corollary 2 Let e, 5 he positive numbers less than 1, and Ps2 = 0. Suppose that N is the 
minimum positive integer such that (fl5|) holds. Then, 



Proof. In reference to the sets of the events as illustrated in Figure 2, the hypothesis Ps2 = 
implies 



{y-2 y2 y-2 y2 

Suppose that (o"|^,(Ty) G 5i n52. Then some algebraic manipulations yield that 



I (1 + ^)^2^ < (l-e)^2VJ 

As a result 5i n ^2 C 5/f,y and thus Fr{SH,v} > Pr{5i nS2} > I - 6, if N satisfies the I^Si) by 
Remark 3. Therefore the corollary is true. □ 

In the case Ps2 7^ 0, the result in Corollary [2] needs to be replaced by a more complex 
expression: 



Pr < 



< < V ^^1/ -■ l^ _ ^ I > i_5 (30) 



l±f ) P.iX^ - P.2X? ~ 4 ~ fe) P.iX^ - P.2X,V P.i 



if the positive integer N satisfies ([28]), and if (^]^^ PsiX^ j^ - Ps2Xf j^ > and (j^^ PsiX^ 
Ps2Xf ^ > 0. The above reduces to that of Corollary [2] in the case Ps2 = 0. 
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We investigate next whether or not the interval estimates presented in Theorem [3] and Corol- 
lary [2] are tight. Such an issue is clearly dependent on the average transmitting powers Psi and 
Ps2- Recall that Psi > Ps2 ^ 0. Intuitively the larger Psi and the smaller Ps2 are, the tighter the 
interval estimates are that is validated by the following result. 

Theorem 4 Let e, 5 be positive numbers less than 1, and N = N^2 — 1 > -^'^mi with N^i and 
iVm2 the minimum positive integers satisfying ( | j7[ ) and l\28\i . respectively. Then 



l-5<Pr(-r^(^-^| <a|,<-r^(^-^U<l-- (31) 
for sufficiently large Pgi with constant Ps2- In addition 



- [AP, l^l + e AP, ^1-e 1 + J 

for sufficiently small Ps2 with constant P^i . Finally 1 — | is also an upper bound for the confidence 
level in Theorem and Corollary with sufficiently large Psi and sufficiently small Ps2, if N = 

Nra2 - 1. 

Proof. In light of Remark 4 and the hypothesis on N, there holds 



= Pr {(1 - e)iPsiajj + a^.) <xf^ < {1 + e){Psiol + 4)} 

^ Pr{(l-e)4<4;^)<(l + e)4}>l-<5 
where 5^^^^ is the limit of j^, a point estimate for to be investigated later: 



j^2 ( j^2 __ 1 

S^u^^^ = lim — = lim < a% ^r := — > (33) 

^'^ fti-oo Psi Psi^oo\ ^'^ Psl-Ps2 J ^ ' 

The last inequality follows from the hypothesis on A'^m2 > -^mi and from the fact that Psi — > 
oo corresponds to the noise- free case in Section 3. Recall Sh as defined in (j26p that can be 
alternatively described as 



where 5Ps = ^1 — ^ j . It is easy to see that as Psi — > oo, 

Pr {5^,} ^ Pr {(1 - e)4 < a^^^ < (1 + e)al] >l-5 



14 



It follows that the lower bound in (j3ip is true by taking P^i sufficiently large. On the other hand 

Fr{SH}^Pr[{l-e)ajj <al[p < (1 + e)ajj] < VT^ 
It follows that there exists P^i > such that 



1 /. r. . 5 



Fi{Sh} <Vl^+-[l-VT^) =1 2 

provided that Psi is large enough that concludes the upper bound in ([3T]) . The proof for ([32]) 
is similar. Indeed by applying the result from the previous section and using the hypothesis 



= Pr {(1 - e)iPs2aj, + 4) < ^ < (1 + e){Ps2<7H + 4)} 

^ Pr{(l-e)4 <^< + > 1-5 

as Ps2 0. Recall Sy as defined in i\27\\ . Then 

1-->VT^> lim Pr{cSy} = Pr|(l-e)4 < Xf^ < (l + e)^) > 1-5 

It follows that both lower and upper bounds in (j32p are true by taking Ps2 > sufficiently close 
to 0. Finally the proofs for the rest of the theorem are omitted because they are similar to those 
for the lower bounds in (1311) and (1321). □ 



Remark 5 Theorem H] shows that the conservativeness of the coverage probability can be con- 
trolled within |. Since the experimental effort grows in the order of ln(|) for a fixed relative 
width of the confidence interval, a gain of | for the coverage probability can be obtained at the 
cost of increasing the experimental effort by 

Inl^T 



It can be seen that this percentage is very insignificant for small 6. Therefore, the conservativeness 
of the proposed interval estimation can be made very insignificant by choosing large Pgi and small 

Ps2. 

The hypothesis A^m2 > ^mi in Theorem U] is generically true for small 5 and e in light of 
the fact that A^m2 In (|) ~ A^'mi In (|). Because the limiting case P^i — > oo is equivalent to the 
noiseless case, there hold 



hm Pr < -; ^— — < aff < — ^— — > > 1 - 0, lim Pr < - — '— < ay < - — — > > 1 - d 

p.i^oo |(l + e)P,i ^ (l-e)P,iJ p.i^-- [l + e ^ ^-^} 

provided that N > ^''^"'"3^^°^^'' ^ ^mi where e and S are positive numbers less than 1. The 
sample complexity bound for the limiting case improves the one in Theorem [H 
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4.2 Point Estimate 



In light of the results in [13], ^ = 1 or £ = 2) is the ML estimator for Pgecrfj + ay that 
is both sufficient and complete statistic. Let ajj j^f and S'y^ be point estimates for aj^ and ay, 
respectively based on Xf and X^ j^- Then 



PslCrH^j^ + (TyN — Xf^^, Ps20-'h^n + '^V,N — XIj^ (35) 
giving rise to the following expressions for the point estimates (recall AP^ = Pgi — Ps2 > 0): 

'^'h,N = ^pT (^l,7V - ^2,Ar) ' '^V,N = ^pT (^sl^2,Ar " ^^2X1^^^ (36) 

Our next result shows that both and ^yj^ are optimum estimators for a"^ and ay, respec- 
tively. 

Theorem 5 Let {Xi^k}k=i and {X2,k}k=i be 2N i.i.d. noisy samples with Psi > Ps2 > 0. Then 
afj and ayj^ as in are unbiased ML and MV estimates for al^ and ay, respectively that 
achieve the Cramer- Rao lower hound. Furthermore Xf and X^j^j as in @ are sufficient and 
complete statistics. 



Proof. It can be easily verified that E[X|^] = Pseaj^ + ay for £ = 1,2 implying that E[a|^ jy] = ajj 
and E[ay^^^] = ay. Thus the estimator in (|36p is unbiased. By independence the joint PDF for 
{-'^i,fe}^=i and {X2,k}k=i is given by 

fx {{X,,k}Li,{X2,k}ti) = fx {{X,,k}ti) fx {{X2,k}ti) (37) 
by an abuse of notation where for either ^ = 1 or £ = 2, 



fx {{Xe,k}k=i) = -TB — 2 \_ 2w ^^P I l^d^A'l) \ ^'^ 



{Psia'j, + a'^r \tl " 1 PsecT^ + a^ 



2 _L^2^ 



Taking natural logarithm on both sides yields 



N NX^ NX'^ 

Hfx) = - IniPsi^l + 4)^ - HPs2CtI + 4)^ + E 1^(1^1,^^2.1 ) - p - p 2T2 

^ Psiafj + (Jf Ps2CrH + o-y 

Setting partial derivatives of ln(/x) with respect to ajj and ay to zeros lead to the following two 
equations: 



Pi'^^^In , Ps^XIm P^i P^2 



_ 1_ 



{Psiajj + a^y {Ps2(Tjj + alf Psia]j + al Ps2(tI + 

^1 /V ^2./V i i 



^1,A^ , ^^2,N 



(P,ia2, + 4)2 (^,2^2^ + 4)2 Psiaj, + a^y P.2^|, + ^ 



Solving for and X^ ^ from the above two equations coincide with the expressions in ([35]) 

at a^ = ajj jsi and o'y = ayj^ that in turn gives the point estimates in (j36j) . The uniqueness 
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of the solution implies that the points estimates in (j36p are indeed ML that maximize the PDF 
/x(-) for every pair of sets of i.i.d. noisy measurement samples satisfying the hypothesis. 

r -iT 

Denote 6 = aj^ ay as the parameter vector for estimation where superscript denotes 
transpose. Then the corresponding FIM (Fisher information matrix) can be shown to be, after 
lengthy calculation, 



Fim(o-|^,cj^) :=E 



de 



89 



N 





+ 


p2 






Psl 


+ 


Ps2 









Ps2 



+ 

"1 

~^ ~\ J 

0"l ^2 



where for simplicity in notations, ai = Psicrfj + (^v used with i = 1,2. Recall that the inverse of 
Fim(a"|^, ay) is the smallest error covariance achievable by all unbiased estimators. In arriving to 
the above expression, the fact that E[G^] = Su^ for G distributed as ^{0, a), and the observations: 



E 



E 



E 



{Xl^){Xl^) = {Psiajj + ai,){Ps2Cjij + a 



{Psicj\ + + -{P,,a\ + 4)2, 



1,2 



are crucial. Now with the point estimates in (j36p . the corresponding error covariance can be 
shown to be 



Gov (4, 4) 



E 



^2 2 



a 



a 



H 



'V,N 



crt 



1 



NAP., 



-{Psial + Ps2af: 



-{Psial + Ps2Cjf) 



where again the notation = Psecrjj + 4 with i = 1,2 is used. Consequently there holds the 
identity Fim(4) o'y)Cov(4) 4) ~ validating the fact that the Cramer-Rao lower bound is 
indeed achieved by the point estimates in (I36p that are indeed MV estimates. Finally the sufficient 



and complete statistic of Xf and X^ can be shown in the same way as in [13]. Specifically 
the joint PDF in ()37p has the form 

AT 

fx=g (^X^^, 4> 4) ^ ({-'^i,fc}^=i' {-^2,fc}^=i) , h{-, •) = n 



2,i| 



Hence in light of the Neyman factorization criterion, X^ ^ and X^ ^ are sufficient statistics. The 



proof for the complete statistics is again the same as that in [13] that is skipped. 



□ 



The result on the Cramer-Rao lower bound for finite N in Theorem [5] is surprising which is 
normally achievable only asymptotically. Next we present several results for the point estimates 
in (I36p regarding the sample complexity bound. We begin with a corollary that follows from the 
results on interval estimates in Subsection 4.1. 
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Corollary 3 Under the same hypotheses as in Theorem [7} there holds 
for sufficiently large P^i with constant Ps2- In addition 



(38) 



1 - 5 < Pr 



^2 2 



a- 



V 



(39) 



for sufficiently small Ps2 with constant Psi- 



Proof. We prove only (j38p as the proof for (j39p is similar that will be omitted. Define the set of 
events: 



■Sh ■■= : 



_ y2 



Then C 5//, and thus Pr{5i^} < Pr{5i^}. More importantly Sh Sh as Pgi oo. 
Therefore 



( ^2 ^2 

PrjcSHj = Pr < — ^ <crH < 



1 + e 



1 - e 



Pr 



?2 _ rr^ 



H 



as Psi oo. A similar argument as in the proof of Theorem S] can thus be used to conclude ([38|) . 
□ 

Similar to the discussion after Remark 5, we have that for N > 2(^+^^) s ^]^Qj-e hold 



lim Pr ■ 

P5I— »oo 



H,N 



H 



< £ } > I - 6 hm Pr 

Ps2~>0 



a 



V,N 



V 



<e)>l-5 (40) 



where e and 5 are positive numbers less than 1. The next result is concerned with the point 
estimate related to SNR: 



a 



H,N 



_ y2 
^1,N ^2,N 



Theorem 6 Let e and 6 be positive numbers less than 1. Let Ps2 = 0. Suppose that N is 



(41) 



the minimum positive integer such that F^2^2N [^2A^(1 + 2+^)) ~ ^x'^-2N (^2A^(1 — 2+i)j ^ VT^-S 
where F^2 2n{') denotes the CDF of random variable with 2N degrees of freedom. Then 



P.1-+00 





^2 


^-1 


< 
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Proof. Define two normalized random variables by 



7H,N 



N 



N '■- 



y2 



V 



a 



(42) 



V 



Straightforward algebraic manipulations give the following chain of equations: 

?2 



Pr < 





_ Z|. 




< 











Pr 



Pr 



l + e 



l-e 



a 



II <^< 



2,N 



H(^-)<i:<(^-) 



y2 



Pr 



+ 9h,n P si{l + e)a']j + al 



Psicrjj + <T^ 



< 



< 



N 



Psicth + air 



Pr < 1 - e < <l + e 



N 



as - 
Se 



oo. To complete the proof, define two sets of events as follows: 

^H,N, Ov,n) ■■ (1 - e)Ov,N < Oh,n < (1 + £:)0v,N^ , 9{e) :-- 



2 + e 



^H,N, Ov,n) ■■ 1 - g{e) < Oh,n < 1 + gie) & 1 - g{e) < 0v,n < 1 + 



It can be shown that Se ^ Sg. Indeed in the plane of {9h,n ,&v,n)-, the set 5^ defines a square 
area inside the sector area defined by the set 5^. More specifically 



Se c <j (0H,7v, ev,N) ■■ 1 - < ^H,N < 1 + gie) & 1 - g{e) <ev,N<l+ ^ 



2-e 



It follows that as Pgi — > oo, there holds 



2-e 



Pr O - e < 



Gv,N 



< 1 + e ^ > Pr{cSe} 



= Vi^l-gie) <eH,N <l + g{e)^Vi[l- g{e) <ev,N <l+g{e)] >l-5 
by independence of the events of 9h,n and 9h,n, and by the hypothesis on N . □ 

))>yr^,ifiv>^(^+^)(^+^^)'"^ 



By noting that F^2^2N \ 2N{1 + 
the next result follows from Theorem [6l 



2+e- 
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Corollary 4 Let e and 6 be positive numbers less than 1. Suppose that Ps2 = 0. Then 

lim Pr 

provided that N > ^^^"^^'"'3^^^^'' ^° ^ ~ ^'"^^^ for small e. 

We note that ^^^"'"'^■^^^^^'^■^ '"^ ~s ~ ^^^^^^ for small e. Thus the a priori bounds for the sample 
complexity in Theorem [6] and Corollary H] are roughly 4 times to that in Corollary [3l It signifies 
the difficulty in estimation of SNR in Rayleigh channels, and indicates that the margin of error 
manifested by e is more expensive to reduce as compared with the level of confidence manifested 
by 5. 



N 



<£> > l-(5 



5 Numerical Simulations 

This section presents numerical results to illustrate our proposed statistical theory in measure- 
ments and estimation of Rayleigh fading channels. For simplicity a\ = 1 and Psi = 1 are assumed 

throughout the section that can always be made true by a suitable normalization. Hence the SNR 

2 

is the same as -7-, and large Pgi reduces to large SNR. Moreover we consider only the case Ps2 = 0. 

Because the noiseless case has been shown in Figure 1, we begin with the noisy measurement 
samples under SNR = 20 dB by generating {Xi^i}^^ and {^2,j}i^i iov different sample size N. 
The simple averages ^ as in ([6]) are then calculated for i = 1,2. We choose 6 = 0.01 for the 
associated confidence level. In light of Theorem [3l there holds the joint probability 

Pv{Ai < ajj < A2t Bi <alr < B2} > I- 5 

where Ai, A2, Bi, B2 are functions of e, A^, and ^fjy i = 1,2 which represent the interval 
estimates. In Figure 3 we plotted the ratios 

A2 _ {l + e)xf^-{l-e)xl^ B2 _ Psi{l+e)Xi;;-Ps2{l-e)Xi; 
M {l-e)xf^-{l+E)Xl^' Bi Psi{l-e)Xl^-Ps2{l+e)Xi;; 

for the case Ps2 = with SNR = 20 dB (left) and SNR = 60 dB (right). It is interesting to observe 
that although Xfj^, I = 1,2, are random for each N, the above ratios are almost deterministic 
owing to the small 5 value used. In addition the SNR values affect little for the two ratios at large 
A'' values. We also plotted the noiseless ratio in dashed line as a comparison that should serve as 
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a lower limit. 



▼ Ratio corresponds to channel 

Ratio for the noiseless case 

A Ratio corresponds to noise 



\ 
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▼ Ratio corresponds to channel 

Ratio for the noiseiess case 

A Ratio corresponds to noise 



10 

Sample size N 



10 

Sample size N 



Figure 3: Ratios of the upper/lower confidence limits with SNR = lOdB (left) and SNR = 20dB 
(right) 

2 

For estimation of the SNR, there holds Pi{Di < ^ < D2} in light of Corollary [2] with 



D, _ {l + e)Xl^-{l-e)Xl 



N 



Di ^i-e)Xl^-{l + e)Xl^ 

In Figure 4, the above is plotted against the sample size for the cases SNR = 10 and SNR 
60. 



m 25 

I 20 - 
S 15- 



T Ratio corresponds to SNR = 1 dB 
A Ratio corresponds to SNR = 60 dB 



Sample size N 

Figure 4: Ratios of the upper/lower confidence limits corresponds with 6 = 0.01 

It is commented that for both Figure 3 and Figure 4, the a priori bound > '^^^~^'^^]j^^s^ ^ 
rather than the relation in (j28p . is used. The results are nevertheless close to each other. In 
Figure 5, we plotted e vs. N (left) for the case 5 = 0.05, and plotted 5 vs. N (right) for the 
e = 0.05. In both cases, a priori bounds are used in both the noisy and noiseless cases, plus the 
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use of X in the noiseless case that is governed by the relation in (|17p . 





Figure 5: Plots of e vs. with 5 = 0.05 (left), and 5 vs. N with e = 0.05 (right) 

As expected, the curve based on CDF in the noiseless case serves as a lower bound. In 
addition it is observed that the two curves based on the a priori bounds are almost identical for 
the one on left, and close to each other for the one on right. This fact indicates that our results on 
measurement and estimation of noisy Rayleigh fading channels are not conservative. It is further 
observed that the e curves decrease at a constant slope in log-log scale, and the slope of decrease 
is rather slow with respect to the sample size N . This fact indicates that the reduction of e 
(with fixed 5) is expensive in terms of increasing N . On the other hand the 5 curves decrease at 
accelerated slopes with respect to the sample size N , implying that the reduction of 6 (with fixed 
e) is relatively cheap, especially at large sample size N . Figure 5 validates that the measurement 
sample size is roughly inversely proportional to the square of the margin of error e and is linear 
with respect to the logarithm of the inverse of the gap 5. 

The last simulation example is worked out to demonstrate the optimum estimator obtained 
in Theorem [5l Different from the previous two cases, M(>> 1) sets of measurement samples are 
taken to assess the average performance for the underlying statistical estimation. For each sample 
size N, {Xi^i{k)}f^^ is generated for £ = 1,2, and I < k < M with M = 500. The optimum 
estimator in ([36|) is used to compute estimates f^{k) and ayj^{k). The estimation error is then 
averaged to yield 



RMESj/ 



M 



RMESy 



k=l 

that are plotted together with the Cramer- Rao lower bounds: 
CRBh -- 



1 I 



k=l 



NAP., 



CRBi 



NAP., 
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versus the sample size as shown in Figure 6 where Ps2 = is used. It can be seen that the 
RMSEs coincide very well with the CRBs, validating the optimality of the estimator in (j36p . 
Again the change of SNR affects little on estimation of a'jj but changes the RMSE for ay that is 
mainly due to the change of ay by a factor of 10. In the case M < 500, the RMSE lines are less 
straight and fluctuate more as M becomes smaller, but the overall trend holds. 




Sample size N Sample size N 

Figure 6: RMSE and CRB vs. with SNR = 20dB (left) and SNR = lOdB (right) 



6 Conclusion 

Statistical estimation of Rayleigh fading channels has been investigated based on both noiseless 
and noisy measurement samples. Complete solutions are derived for the associated sample com- 
plexity problem and provided for the optimum estimator problem in measurement and estimation 
of Rayleigh fading channels. Specifically our a priori bounds on measurement sample sizes ensure 
the prescribed margin of error and confidence level and are contrast to the existing work reported 
in the literature. In dealing with the noisy measurement samples, our proposed novel signaling 
scheme with two different signal strengths is instrumental in extracting the statistical information 
on mean channel power, noise power, and SNR. Such a novel signaling scheme enables us to derive 
the sample complexity bounds for both interval and point estimates that are tight for the mean 
channel power and noise power albeit less tight for the SNR. More importantly it leads to the 
optimum estimator that is both an ML and MV estimator and that achieves the Cramer-Rao 
lower bound. The results presented in this paper constitute an independent statistical theory 
for measurement and estimation of Rayleigh fading channels. It should be emphasized that the 
sample complexity solution in the noiseless case is also instrumental without which the results 
for the case of noisy measurements are not possible. The numerical simulations illustrate that 
our proposed statistical theory is effective in statistical estimation of Rayleigh fading channels. 
Specifically the simulation examples indicate that our results based on the noisy measurement 
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samples are close to that based on the noiseless measurement samples, and the signal power is 
not required to be high that can be compensated for by using large sample size. Currently we 
are investigating the Nakagami fading channel which in a special case reduces to the Rayleigh 
fading channel, and aim at extension of our results on the measurement sample size and optimum 
estimator. It is our objective to apply our results to other more general wireless fading channels 
and to broad applications of our proposed statistical theory. 
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